Exponential asymptotic optimality of Whittle index policy
نویسندگان
چکیده
We evaluate the performance of Whittle index policy for restless Markovian bandit. It is shown in Weber and Weiss (J Appl Probab 27(3):637–648, 1990) that if bandit indexable associated deterministic system has a global attractor fixed point, then asymptotically optimal regime where arm population grows proportionally with number activation arms. In this paper, we show that, under same conditions, convergence rate exponential population, unless point singular (to be defined later), which almost never happens practice. Our result holds continuous-time model (1990) discrete-time all bandits make synchronous transitions. proof based on nature equation governing stochastic system: it piecewise affine continuous dynamical inside simplex empirical measure Using simulations numerical solvers, also investigate cases, as well how level singularity influences (exponential) rate. illustrate our theorem fading channel model.
منابع مشابه
Whittle Estimation of Exponential Volatility Models
The strong consistency and asymptotic normality of the Whittle estimate of the parameters in a class of exponential volatility processes are established. Among many models of interest, this class includes one-shock models, such as the EGARCH model of Nelson (1991), and two-shock models, such as the SV model of Taylor (1986). The variable of interest might not have finite fractional moment of an...
متن کاملAsymptotic Optimality of Balanced Routing
Consider a system with K parallel single-servers, each with its own waiting room. Upon arrival, a job is to be routed to the queue of one of the servers. Finding routing policy that minimizes the total workload in the system is a known difficult problem in general. Even if the optimal policy is identified, the policy would require the full queue length information at the arrival of each job; fo...
متن کاملAge of Information: Whittle Index for Scheduling Stochastic Arrivals
Age of information is a new concept that characterizes the freshness of information at end devices. This paper studies the age of information from a scheduling perspective. We consider that a base-station updates many users on stochastic information arrivals over a wireless broadcast network, where only one user can be updated for each time. In this context, we aim at developing a transmission ...
متن کاملScheduling a Multi Class Queue with Many Exponential Servers : Asymptotic Optimality in Heavy Traffic
We consider the problem of scheduling a queueing system in which many statistically identical servers cater to several classes of impatient customers. Service times and impatience clocks are exponential while arrival processes are renewal. Our cost is an expected cumulative discounted function, linear or nonlinear, of appropriately normalized performance measures. As a special case, the cost pe...
متن کاملAsymptotic approximation of exponential integrals
1 Preliminaries 1 1.1 What this is . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1 1.2 Problem statement . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1 1.3 Big-O and small-o notation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1 1.4 Definition: Asymptotic approximation ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Queueing Systems
سال: 2023
ISSN: ['1572-9443', '0257-0130']
DOI: https://doi.org/10.1007/s11134-023-09875-x